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APPENDIX C - Findings and Domain Comparisons 
Decision Rules 

This section provides an oven’iew of the decision rides used to translate the statistical analyses into substantive findings. 

Full Set of Subdomain Findings with Survey Items Reported in Initial Research Report 

This section lists all the subdomains — and the specific items contained within them — which are reported in this study as having 
a positive and significant correlation to higher student outcomes. 

Statistical Comparisons Across Study Domains — Figures C-l-C-4 

This section includes four charts that compare the relative strength of the ten study domains — across all outcomes — with 
respect to: 

■ Longitudinal Principal and Teacher subdomains 

■ Longitudinal Principal and Teacher and Superintendent subdomains 

■ Cross-sectional Principal and Teacher subdomains 

■ Cross-sectional Principal and Teacher and Superintendent subdomains 
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APPENDIX C- Decision Rules 

The research team’s decision rules for reporting findings 

In order to translate the large set of numerical outputs from our cross-sectional and longitudinal regression 
analyses into substantive findings to report, it was necessary for the research team to interpret and make 
judgments about stronger versus weaker findings, consistent themes, and a limited number of instances where 
the regression outputs could not be interpreted sufficiently. The goal was to distill and report findings that are 
both coherent and defensible. 

In doing this, we adopted a number of decision rules: 

• Subdomains that correlate positively and significantly at the .05 level of statistical significance with 
multiple CST outcomes — in either the cross-sectional analyses, the longitudinal analyses, or both — 
should be reported. 

• Subdomains that correlate positively and significantly in both the cross-sectional and longitudinal 
analyses should be reported. 

• Within a given domain, multiple principal, teacher, and/or superintendent subdomains that reinforce 
one another — i.e., address the same practices or policies, or complementary aspects thereof — and 
correlate positively and significantly should be reported. 

• Across domains, subdomains that are consistent with themes already identified in other domains and 
correlate positively and significantly should be reported. 

• With respect to subdomains that correlated positively and significantly with only one CST outcome for 
a single analysis (cross-sectional or longitudinal), these were variously: 

o Dropped as reportable findings on the grounds that they were weak or “one-off’ outputs, 
especially in cases where the regression output pertained to a single SCI band; 

o Reported, on the grounds that they correlated with a “summative” CST outcome of relevance, 
such as the Grade 8 English Language Arts CST. 

o Reported, on grounds that they were analyzed against few possible outcomes. A subdomain 
pertaining only to practices in grade 6 — or to a particular grade and subject area — might only be 
relevant to one or a few outcomes, for example. 

• Confounding or confusing subdomains were dropped. These were cases where: 

o A subdomain variable clearly did not operate as intended; 

o The subdomain variable was plausibly influenced by student achievement, or by some omitted 
variable correlated with student achievement; or 

o Several subdomains contradicted one another, or extensive further study was required to 
develop a responsible understanding of the finding (perhaps to be taken up in future reports). 
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APPENDIX C - Full Set of Subdomain Findings with Survey Items Reported in Initial Research Report 

This study found that its ten research domains fell into three “groupings” with respect to their relative predictive strength 
in differentiating higher-performing middle grade schools in our sample. 

• Grouping #1 : The domain with the greatest predictive strength across most of the cross-sectional and longitudinal 
analyses was Domain B, “An intense, school-wide focus on improving academic outcomes.” 

• Grouping #2: Six domains consistently followed Domain B in terms of predictive strength. Relative to one 
another, their predictive strength varied depending on the analysis, and there were relatively few statistically- 
significant differences between them. These domains pertain to standards-based instruction and curricula; 
extensive use of data; proactive academic interventions; teacher competencies; principal leadership; and 
superintendent leadership. 

• Grouping #3: Three domains, although they did differentiate schools with higher CST scores and higher gains in 
CST scores, did so with less predictive strength than the other seven domains in almost every analysis conducted. 
These three domains pertain to school environment; organization of time and instruction; and attention to student 
transitions. 

Equally important — if not more so — are the specific district- and school-level practices under each domain that 
distinguished higher-performing middle grade schools. This section of Technical Appendix C presents all the 
subdomains — and the survey items contained within them — that were reported as findings in the Initial Research Report. 

• Subdomains that differentiated higher-performing schools with respect to at least one outcome among the 
longitudinal analyses are presented first, by domain. 

• Subdomains that differentiated higher-performing schools with respect to at least one CST outcome among the 
cross-sectional analyses are presented next, again by domain. 

In each case, the domains are presented in order of the three groupings described above. 

A Guide to Understanding the Findings 

Within each domain, superintendent subdomains are presented first, followed by principal subdomains and then teacher 
subdomains. Superintendent subdomains (designated with a letter “S”) contain only items from the superintendent 
survey, principal subdomains (designated with a letter “P”) contain only items from the principal survey, and teacher 
subdomains (designated with a letter “T”) contain only items from the teacher survey. Most subdomains have multiple 
items but some contained only one. The number preceding each item is its survey question number. 

These survey items typically, but not always, asked about the extent to which a particular practice or policy was in effect 
at the school or district, or the frequency with which educators undertook a particular action, often on a five-point scale. 

Generally, subdomains differentiated higher-performing schools in our sample regardless of whether schools were located 
in the 20th-35th or 70th-85th percentiles of the School Characteristics Index (SCI). In a few cases, however, a 
subdomain did so only within one of these two SCI bands. These subdomains are noted as such and listed at the end of 
their respective domains. 

For a summary of further judgments the research team made in deciding which regression results constituted reportable 
findings, see “The research team’s decision rules for reporting findings” section elsewhere in Appendix C. 
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Subdomain Findings from Longitudinal Analyses, 
With Survey Items 

The Top Domain 
(Grouping #1) 
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Subdomain Findings from Longitudinal Analyses 
Domain B 

An intense, school-wide focus on improving academic outcomes 

Superintendent Responses 
S-3 

Superintendent expects middle-grade principals and staff to prioritize improving student achievement regardless of proficiency 
level and for subgroups, and the district sets measurable objectives for improving CST scores across all performance levels and by 
grade level and subject area. 

• What priority do you expect your middle grades principals and staff to place on the following: 

o (S_04a) Improving student achievement for all students regardless of proficiency level, 
o (S 04b) Raising achievement of low income, African American, and/or Latino students. 

• For which of the following does your district/CMO set annual explicit measurable objectives for the middle grades: 

o (S_05c) Improving student achievement across all the CST performance levels (from “far below basic” through 
“Advanced”). 

o (S_05f) Improving grade level and subject area CST scores. 

Principal Responses 
P-3 

School emphasizes improving achievement across all CST performance levels, and setting goals by grade and subject. (2 items) 

• To what extent do you agree with the following statements? 

o (P_l Id) Our school emphasizes improving student achievement across all the CST performance levels (from 
"Far Below Basic" through "Advanced"). 

o (P_l If) Our school sets measurable goals for CST scores by grade level and subject area. 



P-4 

School sets measurable goals for improving district benchmark test scores. (1 item, P_llk) 



P-6 

English language arts and mathematics teachers take responsibility for improving their students’ achievement and grade and 
subject matter teams set goals for student achievement. (2 items) 

• To what extent do you agree with the following: 

o (P_5e) Our school’s ELA and Math teachers take responsibility for improving the achievement of their students. 
° (P 1 lp) Grade and subject matter teams set goals for student achievement. 



P-6 a 

Principal regularly communicates to faculty the importance of high expectations for the achievement of all students. (1 item) 

• (P_05a) To what extent do you agree with the following statements? I regularly communicate to faculty the importance of 
high expectations for the achievement of all students. 

Teacher Responses 
T-2 

Teachers report that meeting and exceeding A YP and API targets are a school priority. (3 items) 

• How much do you agree with the following statements? 

o (T_10a) Our school’s AYP subgroup targets are a priority. 

o (T_10b) Our school’s API growth target is a priority. 

o (T_10c) Our school sets measurable goals that exceed the API growth target. 
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T-3 

Teachers report that the school emphasizes improving achievement across all CST performance levels and sets measurable goals 
for CST scores by grade and subject matter. (2 items) 

• How much do you agree with the following statements? 

o (T_10d) Our school emphasizes improving student achievement across all the CST performance levels (from far 
below basic to advanced). 

o (T_10g) Our school sets measurable goals for CST scores by grade level and subject area. 

T-10 

School’s curriculum and instruction are designed to prepare students for a rigorous high school curriculum. (3 items) 

• Related to students leaving your middle grades to enter high school, to what extent are your school’s instruction and 
curriculum designed to: 

o (T_12a) Prepare all students to leave the middle 
o (T_12b) Prepare all students to leave the middle 
(CAHSEE). 

o (T_12c) Prepare all students to leave the middle 
eligibility (“A-G” courses). 



20th-35th Percentile SCI band ONLY 

Principal Responses 
P-8 

School uses student progress and achievement data as part of teacher evaluations. (1 item) 

• (P_45g) To what extent do you agree with the following statements about teacher evaluations? Our school uses student 
progress and achievement data as part of teacher evaluations. 

Teacher Responses 
T-2a 

Teachers report that district communicates high expectations that schools will meet or exceed state and federal accountability 
targets. (1 item) 

• (T_43c) To what extent do you agree with each of the following statements about your district or CMO? Your district or 
CMO: Communicates high expectations that the school will meet or exceed state and federal accountability targets. 



grades with strong foundational academic and study skills, 
grades on track to pass the California High School Exit Exam 

grades ready to begin taking courses required for UC/CSU 



T-12 

Teachers report that instructional time in their classrooms is protected from unnecessary interruptions. (1 item, T_10k ) 



70th-85th Percentile SCI band ONLY 

Teacher Responses 
T-9 

Teachers frequently communicate with parents about middle-grade academic standards and their student’s progress, and provide 
ways for parents to support their students ’ academic achievement. (7 items) 

• How frequently have you done the following during this school year? 

o (T_07a) Informed parents about the academic standards their students will be expected to meet, 
o (T_07b) Required students to have their parents sign off on homework, 
o (T_07c) Assigned homework that required direct parent involvement or participation, 
o (T_07d) Sent home examples of excellent student work to serve as a model. 

o (T_07e) Provided parents with specific activities they can do to improve their student’s academic achievement, 
o (T_07f) Contacted parents about students’ academic progress. 

• How much do you agree with the following statement? 

o (T_101) Our teachers review CST scores with students and parents. 
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Subdomain Findings from Longitudinal Analyses, 
With Survey Items 

The Middle Six Domains 
(Grouping #2) 
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Subdomain Findings from Longitudinal Analyses 
Domain D 

Coherent and aligned standard-based instruction and curricula 

Superintendent Responses 
S-5 

District expects MG schools to consider a range of factors when placing non-newcomer EL students in English language arts and 
mathematics classes. (10 items) 

• Regarding EL students (non-newcomers), to what extent does the district or CMO expect its middle grades schools to 
consider each of the following in determining EL students’ placement in math or ELA classes? 

o (S_19a) Amount of time in a California school, 
o (S_19b) Language proficiency in English, 
o (S_19c) Language proficiency in native language, 
o (S_19d) Knowledge of academic subjects. 

o (S_19e) Previous academic performance as demonstrated by class grades. 

o (S 19f) Recommendations from prior school/teacher. 

o (S_19g) CELDT scores, 
o (S_19h) CST scores, 

o (S_19i) Other district assessments, 

o ( S_ 1 9j ) Input from p arents . 

Principal Responses 

P-1 (See also Domain J, P-12) 

The principal reports that the district leads decisions about the school’s 6th-8th grade curriculum program adoption in English 
language arts. (1 item) 

• (P_29abcde_l) Who makes the curriculum program adoptions? 

o (A_l) District-wide (or charter management organization) adoption, 
o (B_l) District (or charter management organization) with school input, 
o (C_l) School staff with district (or charter management organization) approval, 

o (D_l) Individual teachers make their own decisions, 
o (E_l) Other(please specify): . 



P-7 

The school has well defined plans for instructional improvement and assesses their effectiveness regularly. (2 items) 

• To what extent do you agree with each of the following statements? 

o (P_l 11) Our school has well defined plans for instructional improvement. 

o (P_l lm)Our school assesses the effectiveness of our instructional improvement plans on an ongoing basis. 



P-8 

School’s English language arts and mathematics instruction is closely guided by state academic standards and state adopted 
curriculum programs, takes into account English Language Development standards, and emphasizes key standards in each grade 
and core subject. (4 items) 

• To what extent do you agree with the following about your school’s overall ELA and Math instruction? 
o (P_37a) Classroom instruction is closely guided by state academic standards, 

o (P_37b) Classroom instruction is closely guided by state adopted textbooks/curriculum programs, 

o (P_37c) Our school emphasizes select key standards at each grade and in each core subject, 
o (P_37d) Instruction for EL students also takes into account state English Language Development (ELD) 
standards. 



P-13 

The school has a structured program to promote literacy across the grade 8 curriculum. (1 item) 

• (P_38E_8) Please indicate which of the following apply to the middle grades reading and ELA instructional practices at 

your school: Our school has a structured program to promote literacy across the curriculum. 
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P-14 (See also Domain I, P-18) 

Principal expects the school’s English language arts teachers to use the school’s adopted English language arts curriculum 
frequently. (1 item) 

• (P_30) As a principal, how often to you expect your school’s ELA teachers to use the school’s adopted English Language 
Arts curriculum program? 

o No requirement, 
o Weekly, 
o 3-4 times per week, 
o Daily. 

o No expectation for text use, but do expect teachers to align instruction to state content standards. 

P-15 (See also Domain I, P-19) 

Principal expects the school’s mathematics teachers to use the school’s adopted mathematics curriculum program frequently. (1 
item) 

• (P 3 1 ) As a principal, how often to you expect your school’s math teachers to use the school’s adopted mathematics 

curriculum program? 

o No requirement, 
o Weekly, 
o 3-4 times per week, 
o Daily. 

o No expectation for text use, but do expect teachers to align instruction to state content standards. 

Teacher Responses 
T-2a 

Teachers augment the adopted mathematics curriculum. (2 items) 

• How often do you do the following? 

o (T-33d) Augment your school’s curriculum program with additional instructional materials of your own 
choosing. 

o (T-32e) Augment your school’s curriculum program with additional instructional materials provided by the 
school/district. 



T-6 

Teachers collaborate on curriculum pacing, common benchmark assessments, and instruction. (3 items) 
• Overall, to what extent do teachers collaborate to do the following? 
o (T-39i) Discuss curriculum pacing, scope, and sequence, 
o (T-39j) Develop common benchmarks and assessments. 

o (T-39k) Discuss how common benchmarks and assessments relate to instruction. 



T-7 

Teachers report that the school assesses the effectiveness of its instructional improvement plans on an ongoing basis. (1 item, 
T_10j) 

T-8a 

School’s mathematics teachers closely align instruction with the California academic content standards and CSTs, emphasize key 
standards, and work together to break down prerequisite skills. (4 items) 

• To what extent do you agree with the following? 

o (T_31a) Our school’s teachers closely align instruction with the California academic content standards in 
mathematics. 

o (T_31b) Our school’s teachers closely align instruction with the CSTs in mathematics, 
o (T_3 lc) Our school emphasizes selected key standards that teachers prioritize at each grade level. 

• Overall, to what extent do teachers in your school collaborate to do the following? 

o (T_39c) Work together to “break down” the state content standards (e.g., identify prerequisite student skills). 
(Mathematics’ teachers response only) 
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T-9 

Teachers report that district communicates high expectations that instruction will closely align with state standards. (1 item) 
• To what extent do you agree with the following statements about your district or Charter management Organization 
(CMO)? 

o (T-43b) Communicates high expectations that instruction will closely align with state standards. 



70th-85th Percentile SCI band ONLY 

Superintendent Responses 
S-l 

The district leads decisions about schools ’ 6th-8th grade curriculum program adoptions in English language arts. (1 item) 

• (S_12) Who makes decisions about your school’s 6th-8th grade English language arts curriculum program adoptions? 

(Check one) 

o District-wide or charter management organization-wide adoption, 
o District with school input, 
o Each school individually with district approval, 
o Individual teachers make their own decisions, 
o Other (please specify): . 



S-3 

The district leads decisions about schools ’ 6th-8th grade curriculum program adoptions in mathematics. (1 item) 

• (S_13) Who makes decisions about your school’s 6th-8th grade mathematics curriculum program adoptions? (Check one) 

o District-wide or charter management organization-wide adoption, 
o District with school input, 
o Each school individually with district approval, 
o Individual teachers make their own decisions, 
o Other (please specify): . 



Principal Responses 

P-4 

The school has explicit written criteria for placing students in mathematics classes, department chairs revise math placements for 
academic appropriateness, and the administrative team reviews placements to ensure wide access to a rigorous math curriculum. 
(3 items) 

• Please tell us about your school’s placement policies for math: (yes-no) 
o (P_32a_2) Does your school have explicit written criteria? 

o (P_32b_2) Are student placements reviewed by department chairs for academic appropriateness? 

o (P_32c_2) Are student placements reviewed by the administrative team to ensure wide access to rigorous 

curriculum? 
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Subdomain Findings from Longitudinal Analyses 
Domain E 

Extensive use of data to improve instruction and student learning 



Principal Responses 

P-1 (See also Domain I, P-21) 

Principal reports using assessment data extensively and in multiple ways to improve student learning and teacher practice. (6 
items) 

• How often do you use assessment data of any type to do the following? 

o (P_20a) Set goals for the achievement of selected students, 
o (P_20b) Develop strategies to help selected students reach achievement goals, 
o (P_20c) Follow-up on the progress of selected students, 
o (P_20d) Examine our school's teachers’ practices and content knowledge. 

o (P_20e) Determine the professional development needs of individual teachers, or of all teachers in a subject area, 
o (P_20f) Identify areas for schoolwide improvement. 

P-la (See also Domain I, P-22) 

Principal meets with teachers individually, by grade, and by subject to review CST results (including subgroups), and meets with 
the active school to review schoolwide CST scores. (5 items) 

• With regard to your use of assessment data, to what extent do you do the following? 

o (P_19a) I meet with individual teachers to review: CST results, including subgroups, 
o (P_19d) I meet with grade level teachers to review: grade level CST results, including subgroups, 
o (P_19g) I meet with English and/or math teachers by department to review: CST results, including subgroups, 
o (P_19j) I meet with other school administrators to review: schoolwide CST scores, 
o (P_19m) I meet with the entire school staff to review: schoolwide CST scores. 

Teacher Responses 
T-3 

School uses CST scores for placement, promotion, and/or intervention. (1 item, T_10m ) 



T-5 

Teachers receive individual CST data for all students they teach, as well as data disaggregated by skill and subgroup, and 
summarized across grade levels. (4 items) 

• In what forms do you receive CST data? (check all that apply) 
o (T_15a) Individually for all my students. 

o (T_15b) Disaggregated by specific skill/ academic content for all my students, 
o (T_15c) Disaggregated by student subgroup (e.g., racial/ethnic, EL) for all my students, 
o (T_15d) A summary for all students across the grade level(s) I teach. 



T-6 

Teachers frequently administer benchmark, diagnostic, and classroom-based assessments of student learning to inform their 
teaching. (3 items) 

• How frequently do you administer the following kinds of assessments to inform your teaching? 

o (T_13a) Benchmark assessments, which assess whether students are meeting particular academic standards, 
o (T_13b) Diagnostic assessments, which assess what students know and the nature of their misconceptions (such 
as placement or intervention needs). 

o (T_13c) Classroom-based assessments, which assess students throughout a course and guide instruction. 
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T-7 

Teachers use assessment data to evaluate individual student achievement, set measurable goals, help students see progress, correct 
gaps in instruction, and identify effective instructional practices. (5 items) 

• How often do you use student assessment data (of any kind) to do the following? 

o (T_14a) Evaluate individual student achievement, 
o (T_14b) Set measurable goals for individual student achievement, 
o (T_14g) Help students see steady and measurable progress in their learning, 
o (T_14h) Identify and correct gaps in my instruction. 

o (T_14g) Analyze student assessment data to identify effective instructional practices. 

T-8 (See also Domain J, T-15) 

Teachers report that the district supports their data analysis by providing schools with timely CST data and a user-friendly 
information system, and emphasizing regular teacher use of benchmark and/or diagnostic assessments. (3 items) 

• The district or Charter Management Organization (CMO): 

o (T_43d) Provides schools with timely CST student achievement data on all students. 

o (T_43e) Provides a user-friendly computer information system to enable school staff to review student data, 
o (T_43f) Emphasizes regular teacher use of benchmark and/or diagnostic assessments. 



20th-35th Percentile SCI band ONLY 

Superintendent Responses 
S-9 

District gives middle grades staff discretion over developing, determining the need for, and analyzing the results of diagnostic 
assessments. (3 items) 

• Which of the following are true about your district or CMO role related to diagnostic and/or placement tests? (check all 
that apply) 

o (S_09b) Our district allows schools to develop their own diagnostic assessments aligned with the state standards 
by grade and subject for the middle grades. 

o (S_09d) Our district allows educators in our middle grades to determine the need for diagnostic assessments, 
o (S_09f) Our district allows school staff to do their own analysis of the results of diagnostic student assessment 
data. 

Principal Responses 
P-3 

Principal reports that teachers regularly monitor student grades and class test scores to rapidly report student intervention needs, 
discuss and use data to evaluate the achievement of different student groups, and set measurable student goals. (5 items) 

• To what extent do you agree with the following statements? 

o (P_05h) Our teachers regularly monitor student grades and class test scores to rapidly report students for needed 
intervention. 

• To what extent do you agree with each of the following statements about the use of subgroup assessment data by your 
school’s ELA and Math teachers? 

o (P_21a) Teachers use data to analyze student achievement by subgroup, 
o (P_2 lb) Teachers use data to evaluate EL students’ English language proficiency, 
o (P_21c) Teachers set measurable goals for student achievement by subgroup, 
o (P_21d) Our school dedicates time at staff meetings to discuss student achievement by subgroup. 
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Subdomain Findings from Longitudinal Analyses 
Domain F 

Early and proactive academic interventions 



Principal Responses 

P-5 (See also Domain J, P-17) 

Principal reports that the district emphasizes early identification of students needing academic support and addresses the needs of 
students two or more years behind grade level. (2 items) 

• Your school district: 

o (P_53h) Emphasizes early identification of students needing academic support, 
o (P_53k) Addresses the needs of students who are two or more years below grade level. 



P-7 

School staff and parents meet to develop intervention plans for individual students at risk of failure this year. (1 item) 

• Which of the following strategies does your school use to provide academic support for the following types of students? 
o (P40A1) Meetings where teacher, parent, and staff develop an intervention plan for an individual student - 
students at risk of failure this year. 



P-8 

School staff and parents meet to develop intervention plans for individual students identified for intensive intervention. (1 item) 

• Which of the following strategies does your school use to provide academic support for the following types of students? 
o (P_40A_2) Meetings where teacher, parent, and staff develop an intervention plan for an individual student - 
students identified for intensive intervention. 



P-9 

School staff and parents meet to develop intervention plans for individual EL students. (1 item) 

• Which of the following strategies does your school use to provide academic support for the following types of students? 

o (P_40A_3) Meetings where teacher, parent, and staff develop an intervention plan for an individual student - EL 
student. 



P-10 

School employs a range of required intervention strategies for students at risk of failure this year. (4 items) 

• Which of the following strategies does your school use to provide academic support for the following types of students? 
(check all that apply for each group) - students at risk of failure this year. 

o (P_40B_1) Extra instructional time required during the regular school day, perhaps in place of an elective, 
o (P_40C_1) Short term required interventions that run concurrent with class, 
o (P 40D1) Required intervention time outside the regular school day. 
o (P 40F1) Required intersession or summer courses. 

P-11 

School employs a range of required intervention strategies for students identified for intensive intervention. (4 items) 

• Which of the following strategies does your school use to provide academic support for the following types of students? - 
students identified for intensive intervention. 

o (P_40B_2) Extra instructional time required during the regular school day, perhaps in place of an elective, 
o (P_40C_2) Short term required interventions that run concurrent with class, 
o (P_40D_2) Required intervention time outside the regular school day. 
o (P 40F 2) Required intersession or summer courses. 
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P-13 

School provides voluntary academic support (during non-classroom time, A VID, online tutorials) for students at risk of failure this 
year. (3 items checked) 

• Which of the following strategies does your school use to provide academic support for the following types of students? - 
students at risk of failure this year. 

o (P_40e_l) Voluntary academic support offered during non-classroom time (e.g. lunch, after school), 
o (P_40g_l) AVID (Advancement Via Individual Determination), 
o (P_40h_l) An online tutorial or intervention program. 

Teacher Responses 
T-la 

Teachers use differentiated instruction and flexible grouping in the classroom. (2 items) 

• To what extent do you use each of the following instructional practices with your students? 

o (T_34d) Differentiated teaching for individuals or groups of students during regular instruction, 
o (T_34e) Flexible student groupings. 



T-7 

Staff and parents meet to develop intervention plans for individual students at risk of failure this year. (1 item, T_35_al) 

T-10 

School employs a range of required intervention strategies for students at risk of failure this year. (4 items) 

• Which of the following strategies does your school use to provide academic support to the following types of students? 
(check all that apply for each group) - students at risk of failure this year. 

o (T_35b_l) Extra instructional time required during the regular school day, perhaps in place of an elective, 
o (T_35c_l) Short term required interventions that run concurrent with class, 
o (T_35d_l) Required intersession or summer courses, 
o (T_35e_l) Required intervention time outside the regular school day. 

20th-35th Percentile SCI band ONLY 

Teacher Responses 

T-lc (See also Domain I, T-26) 

Teachers report that principal assigns teachers to ensure students with the greatest need are served well. (1 item, T_42p) 

70th-85th Percentile SCI band ONLY 

Teacher Responses 
T-l 

Teachers pre-teach lessons (e.g., lead some students through a lesson the day before) (1 item, T_34a) 



T-5 

District ensures that policies and resources are in place to serve EL students. (1 item, T_43j) 
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Subdomain Findings from Longitudinal Analyses 
Domain H 

Teacher competencies, evaluation, and support 



Principal Responses 
P-1 

Principal reports that a high proportion of the school’s mathematics ancl English language arts teachers are able to use student 
assessment data to improve learning, able to raise student achievement, able to map curriculum standards to instruction, 
understand adolescent development issues, and have other characteristics. (14 items) 

• What proportion of your current 6th-8th grade ELA and Math teachers have the following characteristics? (none-all) 

o (P_4 1 a) Ability to use student assessment data to improve learning, 

o (P_4 lb) Knowledge of California state standards, 
o (P_41c) Fit well into your school culture, 
o (P_41d) Ability to raise student achievement, 
o (P_41e) Strong subject area knowledge, 
o (P_41f) Ability to map curriculum standards to instruction, 
o (P_41g) Likely to remain in the teaching field, 
o (P_41h) Enjoy teaching at the middle grades level, 
o (P_41i) Understand adolescent developmental issues, 
o (P_41j) Taught at this school last year, 
o (P_4 lk) Ability to collaborate effectively with peers, 
o (P_4 1 1) Ability to make personal connections with students, 

o (P_41m) Well prepared by their teacher credential program (new teachers), 
o (P_41n) Expertise working with EL students. 

P-11 (See also Domain J, P-21) 

Principal reports that district provides useful professional development for teachers. (1 item, P_52f) 

Teacher Responses 
T-6 

Teacher report that principal provides meaningful teacher evaluation and supports teachers’ professional growth. (5 items) 

• To what extent do you agree with the following statements about your principal? Your school principal: 

o (T_42e) Understands and acknowledges excellent teaching, 
o (T_42g) Arranges for evaluation of my teaching skills by teacher leaders, 
o (T_42h) Ensures that evaluations of my teaching are substantive and meaningful, 
o (T_42i) Ensures that teachers receive effective professional development to improve instruction, 
o (T_42k) Builds strong relationships with teachers and staff. 

70th-85th Percentile SCI band ONLY 

Teacher Responses 
T-4 

Teachers report middle grades are current first choice of teaching assignment. (1 item, T_46) 
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Subdomain Findings from Longitudinal Analyses 
Domain I 

Principal leadership and competencies 



Principal Responses 
P-1 

Principal’s priorities for schoolwide improvement are influenced by expectations from superintendent/school board, CST scores, 
and state accountability measures. (5 items) 

• To what extent do the following influence your priorities for schoolwide improvement? 

o (P_12a) Expectations from my superintendent/school board, 
o (P_12b) CST scores. 

o (P_12f) School statewide ranking on the API. 
o (P_12g) Similar schools ranking on the API. 

o (P_12j) Requirements that come from categorical funding programs. 

P-18 ( See also Domain D, P-14) 

Principal expects the school’s English language arts teachers to use the school’s adopted English language arts curriculum 
program frequently. (1 item) 

• (P_30) As a principal, how often to you expect your school’s ELA teachers to use the school’s adopted English language 
arts curriculum program? 

o No requirement, 
o Weekly, 
o 3-4 times per week, 
o Daily. 

o No expectation for text use, but do expect teachers to align instruction to state content standards. 

P-19 (See also Domain D, P-15) 

Principal expects the school’s mathematics teachers to use the school’s adopted mathematics curriculum program frequently. (1 
item) 

• (P 3 1) As a principal, how often do you expect your school’s math teachers to use the school’s adopted mathematics 

curriculum program? 

o No requirement, 
o Weekly, 
o 3-4 times per week, 
o Daily. 

o No expectation for text use, but do expect teachers to align instruction to state content standards. 

P-22 (See also Domain E, P-la) 

Principal meets with teachers individually, by grade, and by subject to review CST results (including subgroups), and meets with 
the entire school staff to review schoolwide CST scores. (5 items) 

• With regard to your use of assessment data, to what extent do you do the following? 

o (P_19a) I meet with individual teachers to review: CST results, including subgroups, 
o (P_19d) I meet with grade level teachers to review: grade level CST results, including subgroups, 

o (P_19g) I meet with English and/or math teachers by department to review: CST results, including subgroups. 

o (P 1 9j) I meet with other school administrators to review: schoolwide CST scores. 

o (P_19m) I meet with the entire school staff to review: schoolwide CST scores. 



P-23 

Principal meets with teachers individually, by grade, and by subject to review benchmark test results, and meets with the entire 
school staff to review schoolwide benchmark scores. (5 items) 

• With regard to your use of assessment data, to what extent do you do the following? 
o (P_19b) I meet with individual teachers to review: benchmark test results, 
o (P_19e) I meet with grade level teachers to review: benchmark test results. 

o (P_19h) I meet with English and/or math teachers by department to review: benchmark test results, 
o (P_19k) I meet with other school administrators to review: benchmark test scores, 
o (P_19n) I meet with the entire school staff to review: benchmark test scores. 
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Teacher Responses 
T-16 

Principal regularly communicates the importance of high expectations for student achievement and holds teachers accountable for 
common planning time to focus on student achievement. (3 items) 

• (T_42a) Principal regularly communicates the importance of high expectations for the achievement of all students. 

• (T_42b) Principal has clear expectations that teachers will meet academic achievement goals for students. 

• (T_42f) Principal holds teachers accountable for using common planning time to focus on student achievement. 

20th-35th Percentile SCI band ONLY 

P-9 (See also Domain J, P-1) 

Principal meets with district administrators to review the school’s CST scores, benchmark test scores, A YP and API progress, and 
grades and/or grading policy. (4 items) 

• With regard to your use of assessment data, to what extent do you do the following? 

o (P_19p) I meet with district administrators to review: our school’s CST scores, 
o (P_19q) I meet with district administrators to review: our school’s benchmark test scores, 
o (P_19r) I meet with district administrators to review: our school’s AYP and API progress, 
o (P_19s) I meet with district administrators to review: our school’s grades and/or grading policy. 



P-10 

District supports the principal if she/he wants to replace the school administrative and/or instructional leadership team. (1 item) 

• To what extent do you agree with the following statements? 

o (P_52c) The district supports me if I want to replace the school administrative and/or instructional leadership 
team. 

P-21 (See also Domain E, P-1) 

Principal reports using assessment data extensively and in multiple ways to improve student learning and teacher practice. (6 
items) 

• How often do you use assessment data of any type to do the following? 

o (P_20a) Set goals for the achievement of selected students, 
o (P_20b) Develop strategies to help selected students reach achievement goals, 
o (P_20c) Follow-up on the progress of selected students, 
o (P_20d) Examine our school’s teachers’ practices and content knowledge. 

o (P_20e) Determine the professional development needs of individual teachers, or of all teachers in a subject area, 
o (P_20f) Identify areas for schoolwide improvement. 

Teacher Responses 

T-26 (See also Domain F, T-lc) 

Teachers report that principal assigns teachers to ensure students with the greatest need are served well. (1 item, T_42p) 

70th-85th Percentile SCI band ONLY 

Principal Responses 
P-5 

Principal has been trained in the evaluation of instruction for EL students, understands the principles of EL second language 
acquisition, and is comfortable conversing in a language other than English. (3 items) 

• To what extent do you agree with the following statements? 

o (P_59f) Principal received training in the evaluation of instruction for ELs. 
o (P_59g) Principal understand the principles of EL second language acquisition. 

• (P_64) Principal is comfortable conversing in a language other than English. 
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Subdomain Findings from Longitudinal Analyses 
Domain J 

Superintendent leadership and district support 



Superintendent Responses 
S-4 

District’s priorities for middle grades improvement are influenced by analysis of student CST scores and progress on other 
measures, and by published statewide ranking of schools. (3 items) 

• To what extent do the following influence your district’s or CMO’s priorities for middle grades improvement? 
o (S_06c) Analysis of student achievement on CSTs. 
o (S_06d) Analysis of student progress on other assessment measures, 
o (S_06f) Published statewide rankings of schools. 



S-6 

District’s priorities for middle-grade improvements are influenced by categorical funding requirements and private grant 
expectations. (2 items) 

• To what extent do the following influence your district’s or CMO’s priorities for middle grades improvement? 
o (S_06g) Requirements that come from categorical funding programs, 
o (S_06h) Expectations that come from private grant funding. 



S-7 

Superintendent evaluation is based in part on middle-grade academic outcomes. (4 items) 

• Asa superintendent or CMO executive, to what extent is your own annual evaluation based upon the following? 

o (S_27e) Improvements in district-wide middle grades student achievement on California Standards Tests, 
o (S_27f) Ensuring more middle grades students are prepared to pass the California High School Exit Exam, 
o (S_27g) Ensuring more middle grades students are prepared for a college preparatory (“A-G”) high school 
curriculum. 

o (S_27h) Improvements in the performance (AYP/API) of middle grades schools. 

Principal Responses 
P-10 

Principal reports that district emphasizes improving student achievement across all CST levels, closing CST subgroup achievement 
gaps, and getting as many studen ts to proficient as possible. (3 items) 

• To what extent do you agree with the following statements? Your school district: 

o (P_53c) Emphasizes improving student achievement across all the CST perfonnance levels, 
o (P_53d) Emphasizes closing achievement gaps on the CST between specific student subpopulations, 
o (P_53e) Emphasizes getting as many students to the CST “Proficient” level as possible. 

P-12 (See also Domain D, P-1) 

Principal reports that district leads decisions about the school’s 6th-8th grade curriculum program adoption in English language 
arts. (1 item) 

• (P_29abcde_2) Who makes the curriculum program adoptions? 

o (A_2) District-wide (or charter management organization) adoption, 
o (B_2) District (or charter management organization) with school input, 
o (C_2) School staff with district (or charter management organization) approval, 
o (D_2) Individual teachers make their own decisions, 
o (E_2) Other (please specify): . 

P-1 7 (See also Domain F, P-5) 

Principal reports that district emphasizes early identification of students needing academic support and addresses the needs of 
students two or more years behind grade level. (2 items) 

• To what extent do you agree with the following statements? Your school district: 

o (P_53h) Emphasizes early identification of students needing academic support, 
o (P_53k) Addresses the needs of students who are two or more years below grade level. 
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P-21 (See also Domain H, P-11) 

Principal reports that district provides useful professional development for teachers. (1 item, P_52f) 

Teacher Responses 

T-14 (See also Domain D, T-9) 

Teachers report that district communicates high expectations that instruction will closely align with state standards. (1 item) 

• To what extent do you agree with the following statements about your district or Charter Management Organization 
(CMO)? 

o (T-43b) Communicates high expectations that instruction will closely align with state standards. 

T-15 (See also Domain E, T-8) 

Teachers report that the district supports their data analysis by providing schools with timely CST data and a user-friendly 
information system, and emphasizing regular teacher use of benchmark and/or diagnostic assessments. (3 items) 

• To what extent do you agree with the following statements? My district or CMO: 

o (T_43d) Provides schools with timely CST student achievement data on all students, 
o (T_43e) Provides a user-friendly computer information system to enable school staff to review student data, 
o (T_43f) Emphasizes regular teacher use of benchmark and/or diagnostic assessments. 



T-21 

Teachers report that district provides useful professional development for teachers. (1 item, T_43h) 

20th-35th Percentile SCI band ONLY 

P-1 (See also Domain I, P-9) 

Principal meets with district administrators to review the school’s CST scores, benchmark test scores, A YP and API progress, and 
grades and/or grading policy. (4 items) 

• With regard to your use of assessment data, to what extent do you do the following? 

o (P_19p) I meet with district administrators to review: our school’s CST scores, 

o (P_19q) I meet with district administrators to review: our school’s benchmark test scores, 

o (P_19r) I meet with district administrators to review: our school’s AYP and API progress, 

o (P_19s) I meet with district administrators to review: our school’s grades and/or grading policy. 



T-4 

Teachers report that the district provides the financial and human resources necessary for the school to meet its goals and visits 
the school at least once a year. (2 items) 

• To what extent do you agree with each of the following statements about your district or charter management organization 
(CMO)? 

o (T_43a) Provides financial and human resources necessary for our school to achieve its goals, 
o (T_43i) Ensures that district staff visits our school at least once a year. 
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Subdomain Findings from Longitudinal Analyses, 
With Survey Items 

The Bottom Three Domains 
(Grouping #3) 
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Subdomain Findings from Longitudinal Analyses 
Domain A 

A positive, safe, engaging school environment 



Principal Survey 
P-1 

Principal enforces a comprehensive set of strategies to ensure a safe and positive school environment. (7 items) 

• Which of the following are true about your school this year? 

o (P_04i) Students are required to maintain minimum performance standards (e.g., behavior, academic, 
participation) to remain at your school. 

• To what extent are the following in effect at your school? 

o (P_10a) A clearly defined dress code that is strictly enforced, 
o (P_10b) A strictly-enforced, zero tolerance policy for drugs and weapons on campus, 

o (P lOc) A strictly-enforced, zero tolerance policy for any type of bullying, 

o (P_10d) Adult supervision is present during all passing and lunch periods. 

o (P_10i) Teachers and administrative staff continuously monitor student behavior to identify students in need of 
intervention. 

° (P_10j) Students receive incentives (e.g., front of line passes, parties, or special events) to reward positive 

behaviors. 

P-4 

A high proportion of students participate in extracurricular activities and course electives. (4 items) 

• Please estimate how many of your students participate in the following classes or activities: 

o (P_08a) One or more extracurricular activities, 
o (P_08b) Course electives: Music, drama, art, dance, 
o (P_08c) Course electives: Exploratory wheel or mini-courses, 
o (P_08d) Course electives: Other. 

Teacher Survey 
T-l 

Teachers report school enforcement of comprehensive safety strategies and that they feel safe in their school. (5 items) 

• To what extent are the following in effect at your school? 

o (T_08b) Our school has a clearly defined dress code that is strictly enforced, 

o (T_08c) Our school has a strictly enforced, zero tolerance policy for drugs and weapons on campus, 

o (T_08d) Our school has a strictly enforced, zero tolerance policy for any type of bullying, 

o (T_08e) Our school has adult supervision during all passing and lunch periods. 

• To what extent do you agree with the following statement? 

o (T_09b) You feel safe in your school. 



T-3 

Teachers report that the school clearly communicates policies on student behavior and the importance of attendance to students 
and parents, and that teachers collaborate to develop strategies to address issues. (5 items) 

• To what extent are the following in effect at your school? 

o (T_08a) Our school clearly communicates rules and policies on student behavior to students and parents, 
o (T_08g) Excellent behavior and/or attendance by students gets classroom and/or schoolwide public recognition, 
o (T_08h) The importance of attendance and the consequences of frequent absenteeism, such as academic failure, 
are clearly communicated to students and parents. 

• To what extent do you agree with the following statement? 

o (T_09a) A great deal of your time in class is spent managing student behavior. 

• (T_39h) Overall, to what extent do teachers in your school collaborate to do the following? - Develop strategies to address 
student behavior and/or attendance issues. 
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20th-35th Percentile SCI band ONLY 

P-3 

Principal reports that school staff accept shared responsibility for improving student attendance, such as by personally contacting 
students who cut classes and requiring detention for tardy students. (4 items) 

• To what extent do you agree with the following statements: 

o (P_05j) Our school requires tardy students to spend lunch or similar time (non-instructional) in detention. 

• To what extent are the following in place at your school? 

o (P_09a) Our teachers and administrative staff accept shared responsibility for improving student attendance, 
o (P_09e) Our teachers personally contact students who cut their classes. 

o (P_09f) Excellent attendance by students gets classroom and/or schoolwide public recognition. 



P-6a 

School staff regularly analyzes suspension data to ensure criteria are fairly applied to all students. (1 item, P_10g) 
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Subdomain Findings from Longitudinal Analyses 
Domain C 

School organization of time and instruction 



Principal Survey 
P-2a 

The school adjusts the amount of instructional time provided to EL students in English language arts, mathematics, and/or 
English language development based on students’ level of fluency, with “reasonably fluent” EL students spending less 
instructional time in these subjects than EL students with “less than reasonable” fluency. 

• Sum of 3 indicators showing whether more ELA, math, and ELD instruction is provided to EL students with “less than 
reasonable fluency” vs. EL students with “reasonable fluency.” (ELA: P_28A_3 vs. P_28A_4 / Math: P_28B_3 vs. 

P 28B 4 / ELD: P_28C_1 vs. P_28C_2) 

P-7 

Amount of time allocated per month for common planning time in grade 7. (1 item) 

• (P_49A_7) Please estimate the following about your ELA and math teacher’s time: Number of minutes per month 
teachers have for common planning time. 

P-8 

Amount of time allocated per month for common planning time in grade 8. (1 item) 

• (P_49A_8) Please estimate the following about your ELA and math teacher’s time: Number of minutes per month 
teachers have for common planning time. 



Teacher Survey 

T-l 

School has subject matter department chairs in English language arts and mathematics. (1 item, T_05) 
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Subdomain Findings from Longitudinal Analyses 
Domain G 

Attention to student transitions 



Teacher Survey 
T-l 

School administrative staff and teachers review prior CST scores, grades, attendance and behavior reports of students entering the 
middle grades and communicate with elementary teachers. (5 items) 

• Related to incoming students from the elementary grades, to what extent do administrative staff and/or teachers in your 
school do the following? 

o (T_l la) Review prior CST scores for students entering the middle grades. 

o (T 1 lb) Review prior language arts and math grades for students entering the middle grades. 

o (T 1 lc) Review prior attendance records for students entering the middle grades. 

o (T_l Id) Review prior behavior reports for students entering the middle grades. 

o (T 1 If) Communicate with elementary teachers about any students entering the middle grades with low CST 

scores, failing language arts or math grades, poor behavior reports, or poor attendance records. 



T-4 

School administrative staff and teachers implement classroom and intervention strategies to address academic weaknesses among 
incoming students. (1 item, T_llg) 



T-7 

School administrative staff and teachers review prior CELDT scores and other English proficiency information for entering EL 
students. (1 item, T_lle) 



20th-35th Percentile SCI band ONLY 

Principal Survey 

P-1 

School administrative staff and teachers reviews prior CST scores, grades, attendance and behavior of students entering the middle 
grades and communicate with elementary teachers. (5 items) 

• Related to incoming students from the elementary grades, to what extent do administrative staff and/or teachers in your 
school do the following? 

o (P_13a) Review prior CST scores for students entering the middle grades, 
o (P_13b) Review prior language arts and math grades for students entering the middle grades, 
o (P_13c) Review prior attendance records for students entering the middle grades, 
o (P_l 3d) Review prior behavior reports for students entering the middle grades. 

o (P_13f) Communicate with elementary teachers about any students entering the middle grades with low CST 
scores, failing language arts or math grades, poor behavior reports, or poor attendance records. 
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Subdomain Findings from Cross-Sectional Analyses, 
With Survey Items 

The Top Domain 
(Grouping #1) 
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Subdomain Findings from Cross-Sectional Analyses 
Domain B 

An intense, school-wide focus on improving academic outcomes 



Principal Responses 
P-2 

Principal places a priority on meeting A YP subgroup targets, and meeting and exceeding API growth targets. (3 items) 
• To what extent do you agree with each of the following statements? 

o (P_l la) Meeting our school’s AYP subgroup targets is a priority for me. 
o (P_l lb) Meeting our school’s API growth target is a priority for me. 
o (P_l lc) Our school sets measurable goals that exceed the API growth target. 



P-3 

School emphasizes improving achievement across all CST performance levels, and setting goals by grade and subject. (2 items) 

• To what extent do you agree with each of the following statements? 

o (P_l Id) Our school emphasizes improving student achievement across all the CST performance levels (from 
“Far Below Basic” through “Advanced”). 

o (P_l If) Our school sets measurable goals for CST scores by grade level and subject area. 

P-3 a (See also Domain J, P-10) 

Principal reports that district emphasizes improving student achievement across all CST levels, closing CST subgroup achievement 
gaps, and getting as many studen ts to proficient as possible. (3 items) 

• To what extent do you agree with the following? Your school district: 

o (P_53c) Emphasizes improving student achievement across all the CST perfonnance levels, 
o (P_53d) Emphasizes closing achievement gaps on the CST between specific student subpopulations, 
o (P_53e) Emphasizes getting as many students to the CST “Proficient” level as possible. 



P-4 

School sets measurable goals for improving district benchmark test scores. (1 item, P llk) 



P-9 

School regularly communicates to students the importance of middle grades achievement to their future and of taking 
responsibility for their learning, and communicates to parents the importance of their role in setting high expectations for student 
academic success. (7 items) 

• To what extent do you agree with the following statements? 

o (P_05b) Our teachers regularly communicate with students the 

importance of middle grade achievement to doing well in high school. 

o (P_05c) Our teachers regularly communicate with students the importance of middle grade achievement to future 
college goals. 

o (P_05d) Our school faculty tells all students they can do well in school if they work hard. 

o (P_05f) Our school communicates to students the importance of taking responsibility for their own learning by 

attending classes, doing homework, trying their best, and asking for help when needed. 

o (P_05g) Our school communicates to parents the importance of their role in setting high expectations for student 
learning and behavior. 

• Has your school implemented any of the following? 

o (P_06b) Parent outreach to explain the school’s academic expectations and the parent/student role in student 
success. 

o (P_06g) Classroom or schoolwide recognition for improved and/or high student achievement. 
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P-10 

School’s curriculum and instruction are designed to prepare students for a rigorous high school curriculum. (3 items) 

• School’s instruction and curriculum designed to: 

o (P_16a) Prepare all students to leave the middle grades on track to pass the California High School Exit Exam, 

o (P_16b) Prepare all students to leave the middle grades ready to begin taking high school “A-G” courses 

(required for UC/CSU eligibility). 

o (P_16c) Prepare all students to leave the middle grades with strong foundational academic and study skills. 



P-13 

School has requirements or contracts for parent participation. (1 item, P_04f) 

Teacher Responses 
T-2 

Teachers report that meeting and exceeding A YP and API targets are a school priority. (3 items) 
• How much do you agree with the following statements? 

o (T_10a) Our school’s AYP subgroup targets are a priority. 

o (T_10b) Our school’s API growth target is a priority. 

o (T_10c) Our school sets measurable goals that exceed the API growth target. 



T-9 

Teachers communicate with parents about middle grades academic standards and their student’s progress, and provide ways for 
parents to support their students ’ academic achievement. (7 items) 

• How frequently have you done the following during this school year? 

o (T_07a) Informed parents about the academic standards their students will be expected to meet, 
o (T_07b) Required students to have their parents sign off on homework, 
o (T_07c) Assigned homework that required direct parent involvement or participation, 
o (T_07d) Sent home examples of excellent student work to serve as a model. 

o (T_07e) Provided parents with specific activities they can do to improve their student’s academic achievement, 
o (T_07f) Contacted parents about students’ academic progress. 

• How much do you agree with the following statement? 

o (T_101) Our teachers review CST scores with students and parents. 



T-10 

School’s curriculum and instruction are designed to prepare students for a rigorous high school curriculum. (3 items) 

• Related to students leaving your middle grades to enter high school, to what extent are your school’s instruction and 
curriculum designed to: 

o (T_12a) Prepare all students to leave the middle grades with strong foundational academic and study skills, 
o (T_12b) Prepare all students to leave the middle grades on track to pass the California High School Exit Exam 
(CAHSEE). 

o (T_12c) Prepare all students to leave the middle grades ready to begin taking courses required for UC/CSU 
eligibility (“A-G” courses). 



T-12 

Teachers report that instructional time in their classrooms is protected from unnecessary interruptions. (1 item, T_10k) 



20th-35th Percentile SCI band ONLY 

Teacher Responses 
T-2a 

Teachers report that district communicates high expectations that schools will meet or exceed state and federal accountability 
targets. (1 item) 

• (T_43c) Your district or Charter Management Organization (CMO) communicates high expectations that your school will 

meet or exceed state and federal accountability targets. 
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Subdomain Findings from Cross-Sectional Analyses, 
With Survey Items 

The Middle Six Domains 
(Grouping #2) 
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Subdomain Findings from Cross-Sectional Analyses 
Domain D 

Coherent and aligned standards-based instruction and curricula 



Principal Responses 
P-7 

The school has well defined plans for instructional improvement and assesses their effectiveness regularly. (2 items) 

• To what extent do you agree with each of the following statements? 

o (P_l 11) Our school has well defined plans for instructional improvement. 

o (P_l lm) Our school assesses the effectiveness of our instructional improvement plans on an ongoing basis. 

Teacher Responses 
T-la 

English language arts teachers modify or augment the adopted English language arts curriculum with additional materials to meet 
needs of students. (3 items) 

• How often do you do the following? 

o (T_24c) Modify a lesson plan provided in your school’s curriculum program to better fit the needs of your 
students. 

o (T_24d) Augment your school’s curriculum program with additional instructional materials of your own 
choosing. 

o (T_24e) Augment your school’s curriculum program with additional instructional materials provided by the 
school/district. 



T-4 

School considers a range of factors in placing students into general mathematics classes in grades 7 and 8. (9 items) 

• Regarding grade 7 and 8 mathematics courses (General Math), to what extent is each of the following considered for 
determining student placement? 

o (T_29a) A placement or basic skills test developed outside the school district, such as by a textbook publisher or 
university. 

o (T_29b) A placement or basic skills test developed by the department, school, or district, 
o (T_29c) Teacher recommendation, 

o (T_29d) Student prior academic performance, 

o (T_29e) Student CST scores, 

o (T_29f) Parent request and/or perspective, 

o (T_29h) A review by school’s lead mathematics teachers. 

o (T_29i) A review by administrative team to ensure the widest appropriate access for all students, 
o (T_29j) Explicit criteria for placement set by school. 



T-7 

Teachers report that the school assesses the effectiveness of its instructional improvement plans on an ongoing basis. (1 item, 
T_10j) 



T-8 

School’s English language arts teachers closely align instruction with the California academic content standards and CSTs, 
emphasize key standards, and work together to break down prerequisite skills. (4 items) 

• To what extent do you agree with the following statements? 

o (T_23a) Our school’s teachers closely align instruction with the California academic content standards in English 
language arts. 

o (T_23b) Our school’s teachers closely align instruction with the California Standards Tests (CSTs) in English 
language arts. 

o (T_23c) Our school emphasizes selected key standards that teachers prioritize at each grade level. 

• (T_39c) Overall, to what extent do teachers in your school collaborate to do the following? Work together to “break 
down” the state content standards (e.g., identify prerequisite student skills). (English language arts’ teachers response 
only) 
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T-8a 

School’s mathematics teachers closely align instruction with the California academic content standards and CSTs, emphasize key 
standards, and work together to break down prerequisite skills. (4 items) 

• To what extent do you agree with the following? 

o (T_31a) Our school’s teachers closely align instruction with the California academic content standards in 
mathematics. 

o (T_31b) Our school’s teachers closely align instruction with the CSTs in mathematics, 
o (T_3 lc) Our school emphasizes selected key standards that teachers prioritize at each grade level. 

• (T_39c) Overall, to what extent do teachers in your school collaborate to do the following? Work together to “break 
down” the state content standards (e.g., identify prerequisite student skills). (Mathematics’ teachers response only) 



T-13 

English language arts teachers hold students accountable for reading outside of class and teach strategies for writing. (2 items) 
• To what extent do you do the following as part of reading and writing instruction in your classes? 

o (T_27b) Hold students accountable for reading done outside of class (e.g., through discussion, grades), 
o (T_27c) Explicitly teach students strategies for planning, evaluating, and revising their writing. 



20th-35th Percentile SCI band ONLY 

Teacher Responses 
T-6 

Teachers collaborate on curriculum pacing, common benchmark assessments, and instruction. (3 items) 
• Overall, to what extent do teachers in your school collaborate to do the following? 
o (T_39i) Discuss curriculum pacing, scope, and sequence, 
o (T_39j) Develop common benchmarks and assessments. 

o (T_39k) Discuss how common benchmarks and assessments relate to instruction. 
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Subdomain Findings from Cross-Sectional Analyses 
Domain E 

Extensive use of data to improve instruction and student learning 

Superintendent Responses 
S-9 

District gives middle grades staff discretion over developing, determining the need for, and analyzing the results of diagnostic 
assessments. (3 items) 

• (S_09b) Our district allows schools to develop their own diagnostic assessments aligned with the state standards by grade 
and subject for the middle grades. 

• (S_09d) Our district allows educators in our middle grades to determine the need for diagnostic assessments. 

• (S_09f) Our district allows school staff to do their own analysis of the results of diagnostic student assessment data. 

Principal Responses 

P-1 (See also Domain I, P-21) 

Principal reports using assessment data extensively and in multiple ways to improve student learning and teacher practice. (6 
items) 

• How often do you use assessment data of any type to do the following? 

o (P_20a) Set goals for the achievement of selected students, 
o (P_20b) Develop strategies to help selected students reach achievement goals, 
o (P_20c) Follow-up on the progress of selected students, 
o (P_20d) Examine our school’s teachers’ practices and content knowledge. 

o (P_20e) Determine the professional development needs of individual teachers, or of all teachers in a subject area, 
o (P_20f) Identify areas for schoolwide improvement. 



P-3 

Principal reports that teachers regularly monitor student grades and class test scores to rapidly report student intervention needs, 
discuss and use data to evaluate the achievement of different student groups, and set measurable student goals. (5 items) 

• To what extent do you agree with the following statements? 

o (P_05h) Our teachers regularly monitor student grades and class test scores to rapidly report students for needed 
intervention. 

• To what extent do you agree with each of the following statements about the use of subgroup assessment data by your 
school’s ELA and Math teachers? 

o (P_2 1 a) Teachers use data to analyze student achievement by subgroup, 

o (P_2 lb) Teachers use data to evaluate EL students’ English language proficiency, 
o (P_21c) Teachers set measurable goals for student achievement by subgroup, 
o (P_21d) Our school dedicates time at staff meetings to discuss student achievement by subgroup. 

P-8 (See also Domain J, P-15) 

District provides schools with timely CST, CELDT, and district benchmark data; provides a computer-based data system and 
adequate staff training; and uses achievement data to improve and recognize teacher practice. (1 0 items) 

• To what extent do you agree with the following statements? Your school district: 

o (P_54a) Provides schools with timely CST student achievement data, 

o (P_54b) Provides schools with timely CELDT data for EL students. 

o (P_54c) Provides a computer based system to enable school staff to access and review student data, 
o (P_54d) Provides adequate training to our staff to enable effective use of the data management software, 
o (P_54e) Uses student achievement data to identify needs for improved teacher practice, 

o (P_54f) Uses student achievement data to identify and recognize exemplary teacher practices, 

o (P_54g) Communicates clear expectations that instructional decisions will be data driven, 
o (P_54h) Has standards based benchmark tests in each grade and subject that it expects all schools to administer, 
o (P_54i) Analyzes benchmark test data and reports it back promptly to my school, 
o (P_54j) Uses student outcomes to influence school and instructional improvement. 
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Teacher Responses 
T-3 

School uses CST scores for placement, promotion, and/or intervention. (1 item, T_10m) 



T-5 

Teachers receive individual CST data for all students they teach, as well as data disaggregated by skill and subgroup, and 
summarized across grade levels. (4 items) 

• In what forms do you receive CST data? (check all that apply) 
o (T_15a) Individually for all my students. 

o (T_15b) Disaggregated by specific skill/academic content for all my students, 
o (T_15c) Disaggregated by student subgroup (e.g., racial/ethnic, EL) for all my students, 
o (T_15d) A summary for all students across the grade level(s) I teach. 



T-7 

Teachers use assessment data to evaluate individual student achievement, set measurable goals, help students see progress, correct 
gaps in instruction, and identify effective instructional practices. (5 items) 

• How often do you use assessment data (of any kind) to do the following? 

o (T_14a) Evaluate individual student achievement, 
o (T_14b) Set measurable goals for individual student achievement, 
o (T_14g) Help students see steady and measurable progress in their learning, 
o (T_14h) Identify and correct gaps in my instruction. 

o (T_14g) Analyze student assessment data to identify effective instructional practices. 

T-8 (See also Domain J, T-15) 

Teachers report that the district supports their data analysis by providing schools with timely CST data and a user-friendly 
information system, and emphasizing regular teacher use of benchmark and/or diagnostic assessments. (3 items) 

• The district or Charter Management Organization (CMO) 

o (T_43d) Provides schools with timely CST student achievement data on all students. 

o (T_43e) Provides a user-friendly computer information system to enable school staff to review student data, 
o (T_43f) Emphasizes regular teacher use of benchmark and/or diagnostic assessments. 



T-9 

Teachers use assessment data to evaluate student achievement and set measurable goals by subgroup. (2 items) 
• How often do you use student assessment data (of any kind) to do the following? 

o (T_14c) Evaluate student achievement by subgroup (e.g., racial/ethnic, EL), 
o (T_14d) Set measurable goals for student achievement by subgroup. 



20th-35th Percentile SCI band ONLY 

Principal Responses 

P-lb (See also Domain I, P-23) 

Principal meets with teachers individually, by grade, and by subject to review benchmark test results, and meets with the entire 
school staff to review schoolwide benchmark scores. (5 items) 

• With regard to your use of assessment data, to what extent do you do the following? 

o (P_19b) Principal meets with individual teachers to review: benchmark test results, 
o (P_19e) Principal meets with grade level teachers to review: benchmark test results. 

o (P_19h) Principal meets with English and/or math teachers by department to review: benchmark test results, 
o (P_19k) Principal meets with other school administrators to review: benchmark test scores, 
o (P_19n) Principal meets with the entire school staff to review: benchmark test scores. 

70th-85th Percentile SCI band ONLY 

Teacher Responses 
T-2 

Attendance and/or behavior teams meet to review student data and devise solutions. (1 item, T_08J) 
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Subdomain Findings from Cross-Sectional Analyses 
Domain F 

Early and proactive academic interventions 



Principal Responses 

P-3 (See also Domain I, P-27) 

Principal ensures common planning time is available for English language arts and mathematics teachers to meet with 
intervention teachers to coordinate instruction. (1 item, P_50g) 

P-5 (See also Domain J, P-17) 

Principal reports that the district emphasizes early identification of students needing academic support and addresses the needs of 
students two or more years behind grade level. (2 items) 

• To what extent do you agree with the following statements? Your school district: 

o (P_53h) Emphasizes early identification of students needing academic support, 
o (P_53k) Addresses the needs of students who are two or more years below grade level. 



P-6 

Principal reports that the district emphasizes the importance of English language development and subject matter learning by EL 
students, and addresses the needs of EL students who are new immigrants. (3 items) 

• To what extent do you agree with the following statements? Your school district: 

o (P_53f) Emphasizes the importance of English language development by EL students, 
o (P_53g) Emphasizes the importance of subject matter learning by EL students, 
o (P_53j) Addresses the needs of EL students who are new immigrants. 

P-11 

School employs a range of required intervention strategies for students identified for intensive intervention. (4 items) 

• Which of the following strategies does your school use to provide academic support for the following types of students? - 
students identified for intensive intervention. 

o (P_40B_2) Extra instructional time required during the regular school day, perhaps in place of an elective, 
o (P_40C_2) Short term required interventions that run concurrent with class, 
o (P 40D 2) Required intervention time outside the regular school day. 
o (P_40F_2) Required intersession or summer courses. 

Teacher Responses 
T-la 

Teachers use differentiated instruction and flexible grouping in the classroom. (2 items) 

• To what extent do you use each of the following instructional practices with your students? 

o (T_34d) Differentiated teaching for individuals or groups of students during regular instruction, 
o (T_34e) Flexible student groupings. 



T-3 

Subject area teachers meet with intervention teachers to coordinate instruction. (1 item, T_39a) 



T-5 

District ensures that policies and resources are in place to serve EL students. (1 item, T_43j) 



T-7 

Staff and parents meet to develop intervention plans for individual students at risk of failure this year. (1 item, T_35_al) 



T-8 

Staff and parents meet to develop intervention plans for individual students identified for intensive intervention. (1 item, T_35_a2) 
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T-14 

School provides voluntary academic support (during non-classroom time, A VID, online tutorials) for students identified for 
intensive intervention. (Any of 3 items checked) 

• Which of the following does your school use to provide academic support for students identified for intensive 
intervention? 

o (T_35_f2) Voluntary academic support offered during non-classroom time (e.g., lunch, after school), 
o (T_35_g2) AVID tutorials and/or classes, 
o (T_35_h2) An online tutorial or intervention program. 



20th-35th Percentile SCI band ONLY 

Teacher Responses 

T-lc (See also Domain I, T-26) 

Teachers report that principal assigns teachers to ensure students with the greatest need are served well. (1 item, T_42p) 
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Subdomain Findings from Cross-Sectional Analyses 
Domain H 

Teacher competencies, evaluation, and support 



Principal Responses 
P-1 

Principal reports that a high proportion of the school’s mathematics and English language arts teachers are able to use student 
assessment data to improve learning, able to raise student achievement, able to map curriculum standards to instruction, 
understand adolescent development issues, and have other characteristics. (14 items) 

• What proportion of your current 6th-8th grade ELA and Math teachers have the following characteristics? 
o (P_41a) Ability to use student assessment data to improve learning, 
o (P_41b) Knowledge of California state standards, 
o (P_41c) Fit well into your school culture, 
o (P_41d) Ability to raise student achievement, 
o (P_41e) Strong subject area knowledge, 
o (P_41f) Ability to map curriculum standards to instruction, 
o (P_41g) Likely to remain in the teaching field, 
o (P_41h) Enjoy teaching at the middle grades level, 
o (P_41i) Understand adolescent developmental issues, 
o (P_41j) Taught at this school last year, 
o (P_41k) Ability to collaborate effectively with peers, 
o (P_4 1 1) Ability to make personal connections with students, 
o (P_41m) Well prepared by their teacher credential program (new teachers), 
o (P_41n) Expertise working with EL students. 

P-11 (See also Domain J, P-21) 

Principal reports that district provides useful professional development for teachers. (1 item, P_52f) 

Teacher Responses 
T-4 

Teachers report middle grades are current first choice of teaching assignment. (1 item, T_46) 



T-6 

Teachers report that principal provides meaningful teacher evaluation and supports teachers’ professional growth. (5 items) 
• To what extent do you agree with the following statements about your principal? Your school principal: 
o (T_42e) Understands and acknowledges excellent teaching, 
o (T_42g) Arranges for evaluation of my teaching skills by teacher leaders, 
o (T_42h) Ensures that evaluations of my teaching are substantive and meaningful, 
o (T_42i) Ensures that teachers receive effective professional development to improve instruction, 
o (T_42k) Builds strong relationships with teachers and staff. 



T-10 

Teachers collaborate to evaluate lessons and discuss student work. (2 items) 

• Overall, to what extent do teachers in your school collaborate to do the following? 
o (T_39e) Share and discuss student work. 

o (T_39f) Discuss particular lessons that were or were not successful. 
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70th-85th Percentile SCI band ONLY 

Principal Responses 
P-4 

Teachers are surveyed to determine ranked preference of subject/grade-level assignments. (1 item, P_44a) 

Teacher Responses 

T-ll (See also Domain J, T-21) 

Teachers report that district provides useful professional development for teachers. (1 item, T_43h ) 
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Subdomain Findings from Cross-Sectional Analyses 

Domain I 

Principal leadership and competencies 



Superintendent Responses 
S-12 

Superintendent evaluates middle grades principals on the effectiveness of academic interventions, improving student performance 
on district benchmarks and CSTs, improving EL students’ English proficiency, and exceeding state and federal accountability 
targets. (5 items) 

• To what extent do you evaluate your middle grades principals on the following? 

o (S_25c) The effectiveness of student academic intervention strategies, 
o (S_25k) Improving EL students’ progress toward English proficiency, 
o (S_251) Improving student performance on district benchmark assessments, 
o (S_25m) Improving student achievement on the California Standards Tests, 
o (S_25n) Exceeding state and federal accountability targets for student achievement. 

Principal Responses 
P-1 

Principal’s priorities for schoolwide improvement are influenced by expectations from superintendent/school board, CST scores, 
and state accountability measures. (5 items) 

• To what extent do the following influence your priorities for schoolwide improvement? 

o (P_12a) Expectations from my superintendent/school board, 
o (P_12b) CST scores. 

o (P_12f) School statewide ranking on the API. 
o (P_12g) Similar schools ranking on the API. 

o (P_12j) Requirements that come from categorical funding programs. 



P-la 

Principal’s priorities for schoolwide improvement are influenced by recommendations from an external Program Improvement 
provider. (1 item, P_12i) 



P-5 

Principal has been trained in the evaluation of instruction for EL students, understands the principles of EL second language 
acquisition, and is comfortable conversing in a language other than English. (3 items) 

• To what extent do you agree with the following statements? 

o (P_59f) I received training in the evaluation of instruction for ELs. 
o (P_59g) I understand the principles of EL second language acquisition. 

• (P_64) Are you comfortable conversing in a language other than English? (yes-no) 



P-19 

Principal expects mathematics teachers to use the school’s adopted mathematics curriculum program frequently. (1 item) 

• (P 3 1 ) As a principal, how often do you expect your school’s math teachers to use the school’s adopted mathematics 

curriculum program? 
o No requirement, 
o Weekly, 
o 3-4 times per week, 
o Daily. 

o No expectation for text use, but do expect teachers to align instruction to state content standards. 
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P-21 ( See also Domain E, P-1) 

Principal reports using assessment data extensively and in multiple ways to improve student learning and teacher practice. (6 
items) 

• How often do you use assessment data of any type to do the following? 
o (P_20a) Set goals for the achievement of selected students, 
o (P_20b) Develop strategies to help selected students reach achievement goals, 
o (P_20c) Follow-up on the progress of selected students, 
o (P_20d) Examine our school's teachers' practices and content knowledge. 

o (P_20e) Determine the professional development needs of individual teachers, or of all teachers in a subject area, 
o (P_20f) Identify areas for schoolwide improvement. 



P-22 

Principal meets with teachers individually, by grade, and by subject to review CST results (including subgroups), and meets with 
the entire school staff to review schoolwide CST scores. (5 items) 

• With regard to your use of assessment data, to what extent do you do the following? 

o (P_19a) I meet with individual teachers to review: CST results, including subgroups, 
o (P_19d) I meet with grade level teachers to review: grade level CST results, including subgroups, 

o (P_19g) I meet with English and/or math teachers by department to review: CST results, including subgroups, 

o (P_19j) I meet with other school administrators to review: schoolwide CST scores, 
o (P_19m) I meet with the entire school staff to review: schoolwide CST scores. 

P-23 (See also Domain E, P-lb) 

Principal meets with teachers individually, by grade, and by subject to review benchmark test results, and meets with the entire 
school staff to review schoolwide benchmark scores. (5 items) 

• With regard to your use of assessment data, to what extent do you do the following? 

o (P_l 9b) I meet with individual teachers to review: benchmark test results, 
o (P_19e) I meet with grade level teachers to review: benchmark test results. 

o (P_19h) I meet with English and/or math teachers by department to review: benchmark test results, 

o (P_19k) I meet with other school administrators to review: benchmark test scores, 
o (P_19n) I meet with the entire school staff to review: benchmark test scores. 

P-27 ( See also Domain F, P-3) 

Principal ensures common planning time is available for English language arts and mathematics teachers to meet with 
intervention teachers to coordinate instruction. (1 item, P50g) 

Teacher Responses 
T-12 

Principal ensures a clean, safe, and disciplined school environment. (3 items) 

• To what extent do you agree with each of the following statements about your principal? My school principal: 

o (T_42d) Provides support for classroom discipline and management, 
o (T_42m) Ensures that school facilities are kept clean and operational, 
o (T_42n) Ensures a safe campus environment. 



T-16 

Principal regularly communicates the importance of high expectations for student achievement and holds teachers accountable for 
common planning time to focus on student achievement. (3 items) 

• To what extent do you agree with each of the following statements about your principal? My school principal: 

o (T_42a) Regularly communicates the importance of high expectations for the achievement of all students, 
o (T_42b) Has clear expectations that teachers will meet academic achievement goals for students, 
o (T_42f) Holds teachers accountable for using common planning time to focus on student achievement. 

20th-35th Percentile SCI band ONLY 

Teacher Responses 

T-26 (See also Domain F, T-lc) 

Teachers report that principal assigns teachers to ensure students with the greatest need are served well. (1 item, T_42p) 
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Subdomain Findings from Cross-Sectional Analyses 
Domain J 

Superintendent leadership and district support 



Superintendent Responses 
S-2 

Superintendent reports that district functions well across many dimensions (e.g., union, board, staffing, finance). (6 items) 

• To what extent do you agree with the following concerning your school district or CMO? 
o (S_22a) District staff are highly skilled at curriculum and instruction, 

o (S_22b) District staff are highly skilled at financial management, 

o (S_22c) The district school board functions very effectively, 
o (S_22d) The district maintains constructive relationships with employee unions. 

o (S_22e) I am able to negotiate teacher union contracts that place a priority on improved student achievement, 
o (S_22f) District staff are very effective at working with middle grades school sites. 



S-4 

District’s priorities for middle grades improvement are influenced by analysis of student CST scores and progress on other 
measures, and by published statewide rankings of schools. (2 items) 

• To what extent do the following influence your district’s or CMO’s priorities for middle grades improvement? 
o (S_06c) Analysis of student achievement on CSTs. 
o (S_06d) Analysis of student progress on other assessment measures, 

o (S_06f) Published statewide rankings of schools. 



S-7 

Superintendent evaluation is based in part on middle grades academic outcomes. (4 items) 

• Asa superintendent or CMO executive, to what extent is your own annual evaluation based upon the following? 

o (S_27e) Improvements in district-wide middle grades student achievement on California Standards Tests, 
o (S_27f) Ensuring more middle grades students are prepared to pass the California High School Exit Exam, 

o (S_27g) Ensuring more middle grades students are prepared for a college preparatory (“A-G”) high school 

curriculum. 

o (S_27h) Improvements in the performance (AYP/API) of middle grades schools. 

Principal Responses 

P-10 (See also Domain B, P-3a) 

Principal reports that district emphasizes improving student achievement across all CST levels, closing CST subgroup achievement 
gaps, and getting as many students to proficient as possible. (3 items) 

• To what extent do you agree with the following statements? Your school district: 

o (P_53c) Emphasizes improving student achievement across all the CST perfonnance levels, 
o (P_53d) Emphasizes closing achievement gaps on the CST between specific student subpopulations, 
o (P_53e) Emphasizes getting as many students to the CST “Proficient” level as possible. 

P-15 (See also Domain E, P-8) 

District provides schools with timely CST, CELDT, and district benchmark data; provides a computer based data system and 
adequate staff training; and uses achievement data to improve and recognize teacher practice. (10 items) 

• To what extent do you agree with the following statements? Your school district: 

o (P_54a) Provides schools with timely CST student achievement data, 

o (P_54b) Provides schools with timely CELDT data for EL students. 

o (P_54c) Provides a computer based system to enable school staff to access and review student data, 
o (P_54d) Provides adequate training to our staff to enable effective use of the data management software, 
o (P_54e) Uses student achievement data to identify needs for improved teacher practice, 

o (P_54f) Uses student achievement data to identify and recognize exemplary teacher practices, 

o (P_54g) Communicates clear expectations that instructional decisions will be data driven 
o (P_54h) Has standards based benchmark tests in each grade and subject that it expects all schools to administer, 
o (P_54i) Analyzes benchmark test data and reports it back promptly to my school, 
o (P_54j) Uses student outcomes to influence school and instructional improvement. 
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P-1 7 (See also Domain F, P-5) 

Principal reports that district emphasizes early identification of students needing academic support and addresses the needs of 
students two or more years behind grade level. (2 items) 

• To what extent do you agree with the following statements? Your school district: 

o (P_53h) Emphasizes early identification of students needing academic support, 
o (P_53k) Addresses the needs of students who are two or more years below grade level. 

P-21 (See also Domain If, P-11) 

Principal reports that district provides useful professional development for teachers. (1 item, P_52f) 

Teacher Responses 
T-4 

Teachers report that the district provides the financial and human resources necessary for the school to meet its goals, and visits 
the school at least once a year. (2 items) 

• District or Charter Management Organization (CMO): 

o (T_43a) Provides financial and human resources necessary for our school to achieve its goals, 
o (T_43i) Ensures that district staff visits our school at least once a year. 

T-15 (See also Domain E, T-8) 

Teachers report that the district supports their data analysis by providing schools with timely CST data and a user-friendly 
information system, and emphasizing regular teacher use of benchmark and/or diagnostic assessments. (3 items) 

• The district or Charter Management Organization (CMO): 

o (T_43d) Provides schools with timely CST student achievement data on all students, 

o (T_43e) Provides a user-friendly computer information system to enable school staff to review student data, 

o (T_43f) Emphasizes regular teacher use of benchmark and/or diagnostic assessments. 



20th-35th Percentile SCI band ONLY 

T-14 

Teachers report that the district communicates high expectations that instruction will closely align with state standards. (1 item, 
T_43b) 

70th-85th Percentile SCI band ONLY 

Principal Responses 
P-13 

Principal reports that the district leads decisions about the school’s 6th-8th grade curriculum program adoption in mathematics. (1 
item) 

• (P_29abcde_2) Who makes decisions about your school’s 6th-8th grade curriculum program adoptions? 

O District-wide (or charter management organization) adoption. 

O District (or charter management organization) with school input. 

O School staff with district (or charter management organization) approval. 

O Individual teachers make their own decisions. 

O Other. 

Teacher Responses 

T-21 (See also Domain If, T-ll) 

Teachers report that district provides useful professional development for teachers. (1 item, T_43h) 
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Subdomain Findings from Cross-Sectional Analyses, 
With Survey Items 

The Bottom Three Domains 
(Grouping #3) 
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Subdomain Findings from Cross-Sectional Analyses 
Domain A 

A positive, safe, engaging school environment 



Principal Survey 
P-1 

Principal enforces a comprehensive set of strategies to ensure a safe and positive school environment. (7 items) 

• Which of the following are true about your school this year? 

o (P_04i) Students are required to maintain minimum performance standards (e.g., behavior, academic, 
participation) to remain at your school. 

• To what extent are the following in effect at your school? 

o (P_10a) A clearly defined dress code that is strictly enforced, 
o (P_10b) A strictly-enforced, zero tolerance policy for drugs and weapons on campus, 

o (P_10c) A strictly-enforced, zero tolerance policy for any type of bullying, 

o (P_10d) Adult supervision is present during all passing and lunch periods. 

o (P_10i) Teachers and administrative staff continuously monitor student behavior to identify students in need of 
intervention. 

° (P_10j) Students receive incentives (e.g., front of line passes, parties, or special events) to reward positive 

behaviors. 

P-4 

A high proportion of students participate in extracurricular activities and course electives. (4 items) 

• Please estimate how many of your students participate in the following classes or activities: 

o (P_08a) One or more extracurricular activities, 
o (P_08b) Course electives: Music, drama, art, dance, 
o (P_08c) Course electives: Exploratory wheel or mini-courses, 
o (P_08d) Course electives: Other. 

Teacher Survey 
T-l 

Teachers report school enforcement of comprehensive safety strategies and that they feel safe in their school. (5 items) 

• To what extent are the following in effect at your school? 

o (T_08b) Our school has a clearly defined dress code that is strictly enforced, 

o (T_08c) Our school has a strictly enforced, zero tolerance policy for drugs and weapons on campus, 

o (T_08d) Our school has a strictly enforced, zero tolerance policy for any type of bullying, 

o (T_08e) Our school has adult supervision during all passing and lunch periods. 

• To what extent do you agree with the following statement? 

o (T_09b) You feel safe in your school. 



T-3 

Teachers report that the school clearly communicates policies on student behavior and the importance of attendance to students 
and parents, and that teachers collaborate to develop strategies to address issues. (5 items) 

• To what extent are the following in effect at your school? 

o (T_08a) Our school clearly communicates rules and policies on student behavior to students and parents, 
o (T_08g) Excellent behavior and/or attendance by students gets classroom and/or schoolwide public recognition, 
o (T_08h) The importance of attendance and the consequences of frequent absenteeism, such as academic failure, 
are clearly communicated to students and parents. 

• To what extent do you agree with the following statement? 

o (T_09a) A great deal of your time in class is spent managing student behavior. 

• (T_39h) Overall, to what extent do teachers in your school collaborate to do the following? - Develop strategies to address 
student behavior and/or attendance issues. 
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Subdomain Findings from Cross-Sectional Analyses 
Domain C 

School organization of time and instruction 



Principal Survey 
P-4 

Extended instructional time. (1 item) 

• (P_26) Does your school exceed the state’s minimum annual requirements for instructional minutes/days? 

Teacher Survey 

T-l 

School has subject matter department chairs in English language arts and mathematics. (1 item, T_05) 



20th-35th Percentile SCI band ONLY 

Principal Survey 
P-8 

Amount of time allocated per month for common planning time in grade 8. (1 item) 

• (P_49A_8) Please estimate the following about your ELA and math teachers’ time: Number of minutes per month 

teachers have for common planning time. 



70th-85th Percentile SCI band ONLY 

Principal Survey 
P-2a 

The school adjusts the amount of instructional time provided to EL students in English language arts, mathematics, and/or 
English language development based on students ’ level of fluency, with “reasonably fluent” EL students spending less 
instructional time in these subjects than EL students with “less than reasonable” fluency. 

• Sum of 3 indicators showing whether more ELA, math, and ELD instruction is provided to EL students with “less than 
reasonable fluency” vs. EL students with “reasonable fluency.” (ELA: P_28A_3 vs. P_28A_4 / Math: P_28B_3 vs. 

P 28B 4 / ELD: P_28C_1 vs. P_28C_2) 
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Subdomain Findings from Cross-Sectional Analyses 
Domain G 

Attention to student transitions 



Principal Survey 
P-1 

School administrative staff and teachers reviews prior CST scores, grades, attendance and behavior of students entering the middle 
grades and communicate with elementary teachers. (5 items) 

• Related to incoming students from the elementary grades, to what extent do administrative staff and/or teachers in your 
school do the following? 

o (P_13a) Review prior CST scores for students entering the middle grades, 
o (P_13b) Review prior language arts and math grades for students entering the middle grades, 
o (P_13c) Review prior attendance records for students entering the middle grades, 
o (P_l 3d) Review prior behavior reports for students entering the middle grades. 

o (P_13f) Communicate with elementary teachers about any students entering the middle grades with low CST 
scores, failing language arts or math grades, poor behavior reports, or poor attendance records. 

Teacher Survey 
T-l 

School administrative staff and teachers review prior CST scores, grades, attendance and behavior reports of students entering the 
middle grades and communicate with elementary teachers. (5 items) 

• Related to incoming students from the elementary grades, to what extent do administrative staff and/or teachers in your 
school do the following? 

o (T_l la) Review prior CST scores for students entering the middle grades, 
o (T_l lb) Review prior language arts and math grades for students entering the middle grades. 

o (T 1 lc) Review prior attendance records for students entering the middle grades. 

o (T_l Id) Review prior behavior reports for students entering the middle grades. 

o (T 1 If) Communicate with elementary teachers about any students entering the middle grades with low CST 

scores, failing language arts or math grades, poor behavior reports, or poor attendance records. 



T-4 

School administrative staff and teachers implement classroom and intervention strategies to address academic weaknesses among 
incoming students. (1 item, T_llg) 



T-7 

School administrative staff and teachers review prior CELDT scores and other English proficiency information for entering EL 
students. (1 item, T_lle) 
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APPENDIX C - Statistical Comparisons Across Study Domains — Figures C-l-C-4 

The following four charts compare the relative strength of the study domains — across all outcomes — with respect to: 

■ Longitudinal Teacher and Principal subdomains 

■ Longitudinal Teacher and Principal and Superintendent subdomains 

■ Cross-sectional Teacher and Principal subdomains 

■ Cross-sectional Teacher and Principal and Superintendent subdomains 

Each set of figures contains a comparison table that tests whether differences between the domains are statistically significant 
followed by a bar chart illustrating the relative strength of the domains in standard deviation units. The shading on 
comparison charts illustrates which subsets of domains did not differ significantly in explanatory power (pink), those which 
differed at p < .05 but not at p <.01 (yellow), and those that differed at p < .01 (green). Cell entries are p-values. 

Standardized standard deviations (SSDs) are shown in the column head “Std Dev” and also along the top of the figure. 
Domains are ordered from highest to lowest SSD. (For full technical details, see Appendix A - Statistical Comparisons 
Across Study Domains). 

Taken together, these figures show that the ten research domains fell into three “groupings” with respect to their relative 
predictive strength within these models in differentiating higher-performing middle grade schools in our sample. 

■ The domain with the greatest predictive strength across most of the cross-sectional and 
longitudinal analyses — especially for all CST outcomes combined and in mathematics, whether 
for the entire sample or the two different SCI bands — was Domain B, “A school-wide focus on 
improving academic outcomes. ” 

■ Six domains consistently followed Domain B in terms of predictive strength. Relative to one 
another, their predictive strength varied depending on the analysis, and there were relatively 
few statistically significant differences between them. These domains pertain to standards- 
based instruction and curricula; extensive use of data; proactive academic interventions; 
teachers; principal leadership; and superintendent leadership. 

■ Three domains, although they did differentiate schools with higher CST scores and higher 
gains in CST scores, did so with less predictive strength than the other seven domains studied in 
almost every analysis conducted. These three domains pertain to the school environment; the 
organization of time and instruction; and attention to student transitions. 
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Appendix C: Statistical Comparisons Across Study Domains — Figures C-1-C-4 



Figure C-l: Domain Comparisons— Longitudinal, Teacher + Principal Models: Pooled Sample - All Outcomes by Domain 
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Figure C-1 


Explanatory Power of Longitudinal, Teacher + Principal Model 
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Figure C-2: Domain Comparisons— Longitudinal, Teacher + Principal + Superintendent Models: Pooled Sample - All Outcomes by Domain 
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Figure C-3: Domain Comparisons— Cross-Sectional, Teacher + Principal Models: Pooled Sample - All Outcomes by Domain 
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Figure C-3: Explanatory Power of Cross-Sectional, Teacher + Principal Model 
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Figure C-4: Domain Comparisons— Cross-Sectional, Teacher + Principal + Superintendent Models: Pooled Sample - All Outcomes by Domain 
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